View Issue Details

IDProjectCategoryView StatusLast Update
0001883T99X171.00 SKB EaglexTS certificationpublic2024-02-05 10:22
Reporter(SW) Jason LingAssigned To(ALTech) Wooshin Kang Due Date
PrioritynormalSeveritys4-minorReproducibilityalways
Status closedResolutionfixed 
Summary0001883: [Smart3][ATV12][CTS/CTS-ON-GSI] CtsLibcoreTestCases -t libcore.java.security.cert.X509CertificateTest#test_Provider
DescriptionHi Wooshin,

There is a swan build are under testing by 3PL.
They reported one CTS/CTS-ON-GSI failure this morning.

Tool version: CTS 10_R16
command: run cts -m CtsLibcoreTestCases -t libcore.java.security.cert.X509CertificateTest#test_Provider

Tool version: VTS 10_R16 with 2023-02 GSI
command: run cts-on-gsi -m CtsLibcoreTestCases -t libcore.java.security.cert.X509CertificateTest#test_Provider

Before submitting this version, the result of this case was pass.
so we also checked it on eagle10 this afternoon.

I've verified it on 15.540.704. The self-build just pass 3PL-MR.
The result is fail now.

Please check it with AML KR.
Soc vendor must analyze it first and check if it's google issue. if they think its google issue. they can discuss it with Google directly.

For Google, "Before pass, but now fail" is not evidence for requesting waiver.

I think the log in GSI in more clear to analyze

01-30 06:21:58.368 5720 5743 I TestRunner: started: test_Provider(libcore.java.security.cert.X509CertificateTest)
01-30 06:21:58.372 5720 5720 I MonitoringInstr: Activities that are still in CREATED to STOPPED: 0
01-30 06:21:58.433 5720 5743 E System : ******** DEPRECATED FUNCTIONALITY ********
01-30 06:21:58.433 5720 5743 E System : * The implementation of the CertificateFactory.X.509 algorithm from
01-30 06:21:58.433 5720 5743 E System : * the BC provider is deprecated in this version of Android.
01-30 06:21:58.433 5720 5743 E System : * It will be removed in a future version of Android and your
01-30 06:21:58.433 5720 5743 E System : * application will no longer be able to request it. Please see
01-30 06:21:58.433 5720 5743 E System : * https://android-developers.googleblog.com/2018/03/cryptography-changes-in-android-p.html
01-30 06:21:58.433 5720 5743 E System : * for more details.
01-30 06:21:58.564 5720 5743 E TestRunner: failed: test_Provider(libcore.java.security.cert.X509CertificateTest)
01-30 06:21:58.564 5720 5743 E TestRunner: ----- begin exception -----
01-30 06:21:58.565 5720 5743 E TestRunner: java.lang.Exception: Errors encountered:
01-30 06:21:58.565 5720 5743 E TestRunner:
01-30 06:21:58.565 5720 5743 E TestRunner: Error encountered checking AndroidOpenSSL
01-30 06:21:58.565 5720 5743 E TestRunner: junit.framework.AssertionFailedError
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.Assert.fail(Assert.java:48)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.Assert.assertTrue(Assert.java:20)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.Assert.assertTrue(Assert.java:27)
01-30 06:21:58.565 5720 5743 E TestRunner: at libcore.java.security.cert.X509CertificateTest.checkValidity(X509CertificateTest.java:429)
01-30 06:21:58.565 5720 5743 E TestRunner: at libcore.java.security.cert.X509CertificateTest.test_Provider(X509CertificateTest.java:274)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.lang.reflect.Method.invoke(Native Method)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.runTest(TestCase.java:168)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.runBare(TestCase.java:134)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestResult$1.protect(TestResult.java:115)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestResult.runProtected(AndroidTestResult.java:73)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestResult.run(TestResult.java:118)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestResult.run(AndroidTestResult.java:51)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.run(TestCase.java:124)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.NonLeakyTestSuite$NonLeakyTest.run(NonLeakyTestSuite.java:62)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestSuite$2.run(AndroidTestSuite.java:101)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:462)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.FutureTask.run(FutureTask.java:266)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.lang.Thread.run(Thread.java:919)
01-30 06:21:58.565 5720 5743 E TestRunner: Error encountered checking BC
01-30 06:21:58.565 5720 5743 E TestRunner: junit.framework.AssertionFailedError
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.Assert.fail(Assert.java:48)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.Assert.assertTrue(Assert.java:20)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.Assert.assertTrue(Assert.java:27)
01-30 06:21:58.565 5720 5743 E TestRunner: at libcore.java.security.cert.X509CertificateTest.checkValidity(X509CertificateTest.java:429)
01-30 06:21:58.565 5720 5743 E TestRunner: at libcore.java.security.cert.X509CertificateTest.test_Provider(X509CertificateTest.java:274)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.lang.reflect.Method.invoke(Native Method)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.runTest(TestCase.java:168)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.runBare(TestCase.java:134)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestResult$1.protect(TestResult.java:115)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestResult.runProtected(AndroidTestResult.java:73)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestResult.run(TestResult.java:118)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestResult.run(AndroidTestResult.java:51)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.run(TestCase.java:124)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.NonLeakyTestSuite$NonLeakyTest.run(NonLeakyTestSuite.java:62)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestSuite$2.run(AndroidTestSuite.java:101)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:462)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.FutureTask.run(FutureTask.java:266)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.lang.Thread.run(Thread.java:919)
01-30 06:21:58.565 5720 5743 E TestRunner:
01-30 06:21:58.565 5720 5743 E TestRunner:
01-30 06:21:58.565 5720 5743 E TestRunner:
01-30 06:21:58.565 5720 5743 E TestRunner: at libcore.java.security.cert.X509CertificateTest.test_Provider(X509CertificateTest.java:328)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.lang.reflect.Method.invoke(Native Method)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.runTest(TestCase.java:168)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.runBare(TestCase.java:134)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestResult$1.protect(TestResult.java:115)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestResult.runProtected(AndroidTestResult.java:73)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestResult.run(TestResult.java:118)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestResult.run(AndroidTestResult.java:51)
01-30 06:21:58.565 5720 5743 E TestRunner: at junit.framework.TestCase.run(TestCase.java:124)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.NonLeakyTestSuite$NonLeakyTest.run(NonLeakyTestSuite.java:62)
01-30 06:21:58.565 5720 5743 E TestRunner: at androidx.test.internal.runner.junit3.AndroidTestSuite$2.run(AndroidTestSuite.java:101)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:462)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.FutureTask.run(FutureTask.java:266)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
01-30 06:21:58.565 5720 5743 E TestRunner: at java.util.

Thanks,
Jason
TagsNo tags attached.
Attach Tags

Users monitoring this issue

Activities

(SW) Jason Ling

2024-01-30 15:00

developer  

cts-test_Provider_log.zip (369,172 bytes)
gsi-test_Provider_log.zip (147,710 bytes)

(ALTech) Sangmin Choi

2024-01-30 15:08

developer   ~0015044

Hello, Jason,

Could you please provide the test result of swan?

Thank you.
Sangmin Choi.

(SW) Jason Ling

2024-01-30 15:25

developer   ~0015046

Hi Sangmin,

Could you help me post it on Syanptics Jira?

I'll push Syanptics China FAE to check it.

Thanks,
Jason

(ALTech) Sangmin Choi

2024-01-30 15:38

developer   ~0015047

Hello, Jason,

I created the Synaptics jira.
https://synacsm.atlassian.net/servicedesk/customer/portal/173/CSMSKBSBLT-234

Thank you.
Sangmin Choi.

(ALTech) Younkwang Jung

2024-01-30 16:57

developer   ~0015048

Hi Jason

I created the jira below.
https://jira.skbroadband.com/browse/BTFAML-1395

I'll let you know if there's a feedback.

Thank you
YK.Jung

(SW) Jason Ling

2024-01-30 17:40

developer   ~0015049

Last edited: 2024-01-30 17:52

Hi All,

I've checked our all product ATV10~ATV12. all are fail

Please check the following link
https://android.googlesource.com/platform/libcore/+/1ea181fec2e2e0e95298c196193d6fa324d96db7/support/src/test/java/tests/resources/x509/cert-rsa-dates.txt

The certificated was expired in recently day.

Now, there is a pass method to pass it
Modify STB date to 1/26, we can pass it. I am trying to convince our 3PL to do it.
This method only works in VTS tool (GSI image), when test with CTS, the tool will auto turn on "automatic date & time" (if you off it before), so CTS will still fail

But for the next FW
It looks like we should patch this file to update certificate in FW.
As you know, Google no longer maintain ATV10. so I don't know how to patch it.

For ATV12, I think we can wait for Google official patch.
For ATV10, I think we need the Soc vendor suggestion.

Thanks,
Jason

(SW) Jason Ling

2024-01-30 18:54

developer   ~0015050

Hi YK,

It looks like we should backport it
https://android.googlesource.com/platform/libcore/+/1ea181fec2e2e0e95298c196193d6fa324d96db7

Please ask AML KR to review it.

Thanks
Jason

(ALTech) Younkwang Jung

2024-01-31 09:13

developer   ~0015052

Hi Jason

The feedback of amlogic is as follows
====================================================================
Google's test certificate certification expires on 1.26, so tests after 1.26 will fail.

libcore/support/src/test/java/tests/resources/x509/cert-rsa-dates.txt
notBefore=Jan 28 21:42:14 2014 GMT
notAfter=Jan 26 21:42:14 2024 GMT

Please update and test the date as below.
https://android.googlesource.com/platform/libcore/+/1ea181fec2e2e0e95298c196193d6fa324d96db7/support/src/test/java/tests/resources/x509/cert-rsa-dates.txt
====================================================================================================
Please check it

Thank you
YK.Jung
image.png (27,992 bytes)   
image.png (27,992 bytes)   

(SW) Jason Ling

2024-01-31 09:29

developer   ~0015054

Hi YK,

I've patched the following patch yesterday night.
https://android.googlesource.com/platform/libcore/+/1ea181fec2e2e0e95298c196193d6fa324d96db7

But the result is still fail.

I just want to know if this failure should be fix on both side (FW and test tool)
If this failure should also be addressed on tool side, even we applied the patch, we still can not pass it.
Please check it with Amlogic.

And as you know, Google no longer maintain ATV10. so there is no ATV10 daily build tool and fresh GSI image.
so we will still encounter this issue on ATV10

Thanks,
Jason

(ALTech) Younkwang Jung

2024-01-31 16:31

developer   ~0015061

Hi Jason

Please check it again after updating the test tool.

Thank you
YK.Jung
image-2.png (102,276 bytes)   
image-2.png (102,276 bytes)   
image-3.png (86,334 bytes)   
image-3.png (86,334 bytes)   

(SW) Jason Ling

2024-01-31 16:34

developer   ~0015062

Hi YK,

I need to correct my comment.
>>This method only works in VTS tool (GSI image), when test with CTS, the tool will auto turn on "automatic date & time" (if you off it before), so CTS will still fail.
This is wrong, there is an app that always turn on "automatic date & time" when we off it in our other project.

Now, the test method is turning off "automatic date & time" an setting date to 1/26.
Then we can pass CTS/CTS-ON-GSI test_Provider case.

And I've confirmed it again.
Even if we applied the following patch (update the certificated)
https://android.googlesource.com/platform/libcore/+/1ea181fec2e2e0e95298c196193d6fa324d96db7
we still can NOT pass this case.

so in my current opinion,
I think AML should check if this failure should be addressed on both side (FW and test tool)

For ATV12.
I think Google will release new patch and new tool to address it.

For ATV10, Google no longer maintain it.
CTS: Even though we patched it, there are still issues with the testing tool, so we will still fail on this case.
CTS-ON-GSI: the GSI image is released by Google, so we can not patch it. but Google no longer maintain ATV10 GSI, and Google also no longer maintain ATV10 VTS tool, so we will still fail on this case.

Conclusion:
if AML think this failure must be fixed on both side.
Could AML discuss it with Google if we can get waiver for ATV10 project.

Thanks,
Jason

(SW) Jason Ling

2024-01-31 16:44

developer   ~0015063

Hi YK,

I just saw Google updated the daily build tool.
I will check if this failure should be fixed on
1. FW side
2. tool side
3. both side.

Thanks,
Jason

(SW) Jason Ling

2024-01-31 17:36

developer   ~0015065

Hi all,

I've checked it with SWAN (CTS)
It seems that this failure must be solved from the tool side.

Thanks,
Jason
test.jpg (84,095 bytes)   
test.jpg (84,095 bytes)   

(ALTech) Sangmin Choi

2024-02-05 10:10

developer   ~0015089

Hello, Jason,

So, can we close the SoC issue ticket?

Thank you.
Sangmin Choi.

(SW) Jason Ling

2024-02-05 10:21

developer   ~0015090

Hi Sangmin,

No problem. I'll close it.

Thanks,
Jason

Issue History

Date Modified Username Field Change
2024-01-30 15:00 (SW) Jason Ling New Issue
2024-01-30 15:00 (SW) Jason Ling File Added: cts-test_Provider_log.zip
2024-01-30 15:00 (SW) Jason Ling File Added: cts-test_Provider_result.zip
2024-01-30 15:00 (SW) Jason Ling File Added: gsi-test_Provider_report.zip
2024-01-30 15:00 (SW) Jason Ling File Added: gsi-test_Provider_log.zip
2024-01-30 15:00 (SW) Jason Ling Assigned To => (ALTech) Wooshin Kang
2024-01-30 15:00 (SW) Jason Ling Status new => assigned
2024-01-30 15:07 (ALTech) Younkwang Jung Issue Monitored: (ALTech) JunGyu Kim
2024-01-30 15:07 (ALTech) Younkwang Jung Issue Monitored: (ALTech) Younkwang Jung
2024-01-30 15:08 (ALTech) Sangmin Choi Note Added: 0015044
2024-01-30 15:08 (ALTech) Sangmin Choi Issue Monitored: (ALTech) Sangmin Choi
2024-01-30 15:25 (SW) Jason Ling Note Added: 0015046
2024-01-30 15:25 (SW) Jason Ling File Added: swan-gsi-test_Provider_log.zip
2024-01-30 15:25 (SW) Jason Ling File Added: swan-gsi-test_Provider_report.zip
2024-01-30 15:38 (ALTech) Sangmin Choi Note Added: 0015047
2024-01-30 16:57 (ALTech) Younkwang Jung Note Added: 0015048
2024-01-30 17:40 (SW) Jason Ling Note Added: 0015049
2024-01-30 17:51 (SW) Jason Ling Note Edited: 0015049
2024-01-30 17:52 (SW) Jason Ling Note Edited: 0015049
2024-01-30 18:54 (SW) Jason Ling Note Added: 0015050
2024-01-31 09:13 (ALTech) Younkwang Jung Note Added: 0015052
2024-01-31 09:13 (ALTech) Younkwang Jung File Added: image.png
2024-01-31 09:29 (SW) Jason Ling Note Added: 0015054
2024-01-31 16:31 (ALTech) Younkwang Jung Note Added: 0015061
2024-01-31 16:31 (ALTech) Younkwang Jung File Added: image-2.png
2024-01-31 16:31 (ALTech) Younkwang Jung File Added: image-3.png
2024-01-31 16:34 (SW) Jason Ling Note Added: 0015062
2024-01-31 16:44 (SW) Jason Ling Note Added: 0015063
2024-01-31 17:36 (SW) Jason Ling Note Added: 0015065
2024-01-31 17:36 (SW) Jason Ling File Added: test.jpg
2024-02-05 10:10 (ALTech) Sangmin Choi Note Added: 0015089
2024-02-05 10:21 (SW) Jason Ling Status assigned => resolved
2024-02-05 10:21 (SW) Jason Ling Resolution open => fixed
2024-02-05 10:21 (SW) Jason Ling Note Added: 0015090
2024-02-05 10:22 (SW) Jason Ling Status resolved => closed